Papers with multi-task learning approach
Transformer-based Approach for Predicting Chemical Compound Structures (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods to predict chemical compound structures from their names are limited and use handcrafted rules. |
| Approach: | They propose a Transformer-based model that predicts SMILES strings from chemical compound names instead of handcrafted rules. |
| Outcome: | The proposed model achieves higher F-measures than the existing model and the existing one. |
RAMQA: A Unified Framework for Retrieval-Augmented Multi-Modal Question Answering (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing ranking methods rely on small encoder-based ranking models, which are incompatible with modern decoder--based generative large language models (LLMs) Existing methods based on small LLaVA rankers are incompatible with advanced LLMs. |
| Approach: | They propose a framework that combines learning-to-rank methods with generative permutation-enhanced ranking techniques. |
| Outcome: | The proposed framework improves on two benchmarks, WebQA and MultiModalQA, showing significant improvements over baselines. |
On the Generation of Medical Dialogs for COVID-19 (2021.acl-short)
Copied to clipboard
Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, Shu Chen, Xingyi Yang, Yichen Zhang, Qingyang Wu, Zhou Yu, Kun Xu, Eric Xing, Pengtao Xie
| Challenge: | under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors. |
| Approach: | They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients . |
| Outcome: | The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets. |
Rumor Detection by Exploiting User Credibility Information, Attention and Multi-task Learning (P19-1)
Copied to clipboard
| Challenge: | Social media platforms do not always pose authentic information, and rumors spread fear or hate. |
| Approach: | They propose a new multi-task learning approach for rumor detection and stance classification tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art rumor detection approaches on two datasets. |
Neural Machine Translation for Bilingually Scarce Scenarios: a Deep Multi-Task Learning Approach (N18-1)
Copied to clipboard
| Challenge: | Neural machine translation requires large amount of parallel training text to learn a reasonable quality translation model. |
| Approach: | They propose a multi-task learning approach that leverages monolingual linguistic resources in the source side of a machine translation task. |
| Outcome: | The proposed approach is effective on three translation tasks: English-to-French, English- to-Farsi, and English-à-Vietnamese. |
Zero-shot Entity Linking with Less Data (2022.findings-naacl)
Copied to clipboard
G P Shrivatsa Bhargav, Dinesh Khandelwal, Saswati Dana, Dinesh Garg, Pavan Kapanipathi, Salim Roukos, Alexander Gray, L Venkata Subramaniam
| Challenge: | Entity linking maps an entity mention in a natural language sentence to an entity in KB. |
| Approach: | They propose a neuro-symbolic, multi-task learning approach to bridge this gap by exploiting an auxiliary information about entity types. |
| Outcome: | The proposed approach achieves significantly higher performance on four different benchmark datasets when trained with just 0.01%, 0.1%, or 1% of the training data. |
Making Flexible Use of Subtasks: A Multiplex Interaction Network for Unified Aspect-based Sentiment Analysis (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies aim to integrate multiple sub-tasks into a unified ABSA model but suffer from major disadvantages . |
| Approach: | They propose a multi-task learning approach to make use of sub-tasks for a unified ABSA. |
| Outcome: | The proposed model can work well when some sub-tasks are absent, and the interactive relations among subtasks not adequate. |
All-in-one: Multi-task Learning for Rumour Verification (C18-1)
Copied to clipboard
| Challenge: | Automatic resolution of rumours is a challenging task that can be broken down into smaller components that make up a pipeline . previous work focused on rumor detection, rumou tracking and stance classification as separate components . |
| Approach: | They propose a multi-task learning approach that allows joint training of main and auxiliary tasks, improving the performance of rumour verification. |
| Outcome: | The proposed approach improves the performance of rumour verification by combining main and auxiliary tasks into one pipeline. |
Restoring and Mining the Records of the Joseon Dynasty via Neural Language Modeling and Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | voluminous historical records are difficult to fully utilize since they are written in ancient languages and some parts are damaged over time. |
| Approach: | They propose a multi-task learning approach to restore and translate historical documents using a self-attention mechanism. |
| Outcome: | The proposed approach improves the accuracy of the translation task over baselines without multi-task learning. |
Multi-task Learning to Enable Location Mention Identification in the Early Hours of a Crisis Event (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Social media is a platform for people to share their concerns and report information as eyewitnesses of events. |
| Approach: | They propose a multi-task learning approach to leverage available annotated data for several related tasks from the crisis domain to improve performance on a main task with limited annotation. |
| Outcome: | The proposed approach improves performance on a task with limited annotated data. |
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies have focused on conditioned dialogue generation, but there is a scarcity of labeled responses. |
| Approach: | They propose a multi-task learning approach to leverage labeled dialogue and text data to generate conditioned dialogues. |
| Outcome: | The proposed approach outperforms the state-of-the-art models by leveraging the labeled texts and obtains larger improvement compared to the previous methods to leverage text data. |
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing simultaneous translation methods focus on text-to-text and speech-totext translation. |
| Approach: | They propose a Simul-S2ST model that jointly learns translation and simultaneous policy in a unified framework of multi-task learning. |
| Outcome: | The proposed model can perform offline and simultaneous speech recognition, speech translation and speech synthesis via an "All-in-One" seamless model. |
Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant advances in code generation through the ‘Chain-of-Thought’ prompting technique. |
| Approach: | They propose a framework which aims to transfer LLMs’ reasoning capabilities to smaller models through distillation. |
| Outcome: | The proposed framework improves the smaller model's code generation performance by over 130% on the APPS benchmark. |
Hierarchical Multi-Label Classification of Scientific Documents (2022.emnlp-main)
Copied to clipboard
| Challenge: | Automated topic classification is a useful tool for managing scientific documents in a digital collection. |
| Approach: | They propose a hierarchical multi-label text classification dataset with keyword labeling as an auxiliary task. |
| Outcome: | The proposed model achieves a Macro-F1 score of 34.57% and is publicly available. |
Come hither or go away? Recognising pre-electoral coalition signals in the news (2021.emnlp-main)
Copied to clipboard
Ines Rehbein, Simone Paolo Ponzetto, Anna Adendorf, Oke Bahnsen, Lukas Stoetzer, Heiner Stuckenschmidt
| Challenge: | In this paper, we decompose the task of recognizing from the news coverage leading up to an election the (un)willingness of political parties to form a coalition into two related, but distinct tasks. |
| Approach: | They propose a task of recognizing from news coverage the (un)willingness of political parties to form a coalition from text and a sub-task of predicting the polarity of the signal. |
| Outcome: | The proposed approach improves over a strong monolingual transfer learning baseline. |
A Multi-Task Architecture on Relevance-based Neural Query Translation (P19-1)
Copied to clipboard
| Challenge: | Existing models for cross-lingual information retrieval are not aware of the vocabulary distribution of the retrieval corpus. |
| Approach: | They propose a multi-task learning approach to train a Neural Machine Translation model with a Relevance-based Auxiliary Task (RAT) for search query translation. |
| Outcome: | The proposed model achieves 16% improvement over a strong baseline on Italian-English query-document dataset. |
Latent Variable Model for Multi-modal Translation (P19-1)
Copied to clipboard
| Challenge: | Libovick and Helcl (2017) show improvements due to imposing a constraint on the KL term to promote models with non-negligible mutual information between inputs and latent variable and training on additional target-language image descriptions. |
| Approach: | They propose to model interaction between visual and textual features for multi-modal neural machine translation (MMT) using a latent variable model. |
| Outcome: | The proposed model improves over baselines including a multi-task learning approach and a conditional variational auto-encoder approach. |
Unsupervised Domain Adaptation of Language Models for Reading Comprehension (2020.lrec-1)
Copied to clipboard
| Challenge: | State-of-the-art reading comprehension models do not have general linguistic intelligence . accuracy of out-domain datasets is affected by the distribution of data . |
| Approach: | They propose to use supervised RC training data in the source domain and unlabeled passages in the target domain to adapt models. |
| Outcome: | The proposed model outperforms the model without domain adaptation with five datasets in different domains. |
Score It All Together: A Multi-Task Learning Study on Automatic Scoring of Argumentative Essays (2023.findings-acl)
Copied to clipboard
| Challenge: | a multi-task learning approach outperforms sequential approaches for scoring argumentative essays . segmentation and classification of argumentative elements are important steps towards providing feedback on writing structure, but assessing the quality of arguments is less researched . |
| Approach: | They use a student essay dataset to study how argumentative essays are scored . they use automated span detection, type and quality prediction to combine these tasks . |
| Outcome: | The proposed method outperforms sequential approaches for segmentation and quality prediction. |
Dialogue Act-Aided Backchannel Prediction Using Multi-Task Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Backchanneling is a form of feedback that is produced by listeners in a conversation . since the advent of ChatGPT, modern dialogue systems exhibit answer quality levels on par with humans in various professions. |
| Approach: | They propose a multi-task learning approach that learns textual representations for the task of backchannel prediction in tandem with dialogue act classification. |
| Outcome: | The proposed approach improves the prediction of specific backchannels by up to 2.0% in F1 . the audio encoder is pre-trained in a self-supervised fashion using voice activity projection . |
DrFrattn: Directly Learn Adaptive Policy from Attention for Simultaneous Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learn read/write policies from attention mechanism may compromise effectiveness of attention mechanism . |
| Approach: | They propose a method that directly learns adaptive policies from the attention mechanism . experimental results demonstrate that the method achieves an improved balance between translation accuracy and latency. |
| Outcome: | The proposed method achieves improved balance between translation accuracy and latency. |